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SPECIFICATION 
Stereoscopic Image Display Apparatus, Text Data Processing 
Apparatus, Program, and Storing Medium 

TECHNICAL FIELD 

[0001] The present invention relates to a stereoscopic image 
display apparatus, a text data processing apparatus, a program, and • 
a storing medium. 
BACKGROUND ART 

[0002] As an art of performing a stereoscopic viewing, there 
are known various methods such as a glasses-free stereoscopic 
viewing method using a parallax barrier, a glasses-using 
stereoscopic viewing method using polarized glasses, liquid crystal 
shutter glasses, etc., and other methods. Furthermore, regarding 
images to be viewed stereoscopically, besides a live-action image, 
there is an image created by a three-dimensional rendering, that is, 
a rendering process in which an object arranged in a virtual space 
is projected on planes by using computer graphics. In addition, 
by performing the rendering process in two viewpoints, it becomes 
possible to create a right-eye image and a left-eye image. 
Furthermore, it has been proposed a stereoscopic image receiving 
apparatus and a stereoscopic image system for generating a 
stereoscopic image based on depth information extracted from a 
two-dimensional video signal, and the two-dimensional video 
signal ( see Japanese Patent Laying-open No. 2000-78611). If an 
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image file made of the two-dimensional image and the depth 
information is created, the stereoscopic image can be created in 
opening this file. Furthermore, there is proposed a method in 
which the stereoscopic vision viewing is performed on a receiver 
side by broadcasting two images as a 1-channel image (see 
Japanese Patent Laying-open No. H10-174064). If an image file 
composed of two or more images is created, it becomes possible to 
create the stereoscopic image when this file is opened. 

[0003] It is noted that a reference document (Japanese Patent 
Laying-open No. H5-210679) herein shown lists an art in which a 
character decoration of certain characters, or of a string of 
characters is converted into another character decoration. That is, 
a character code and a control code (which indicate a manner of the 
character decoration) of the characters or the string of characters 
to be converted, and the character code and the control code (which 
indicate a manner of the character decoration) of the converted 
characters or string of characters are appropriately set. Next, 
according to such the set condition, the characters or the string of 
characters to be converted are searched from a text, and then, the 
searched characters or string of characters are converted into the 
character code and the control code of the converted characters or 
string of characters. 

DESCLOSURE OF THE INVENTION 

PROBLEM TO BE SOLVED BY THE INVENTION 
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[0004] Currently, electronic character data is accompanied by 
not only a simple character code, but also accompanied by various 
attributes such as a font size, a font type, etc. It is possible to 
freely set these attributes in a unit of characters or a string of 
characters, so that it becomes possible to express the text by a wide 
range of manners by appropriately changing the attributes. 

[0005] On the other hand, as described above, in a field of an 
image display technology, an image display manner using a 
three-dimensional stereoscopic display effect (three-dimensional 
effect) is under consideration and development. Herein, the 
three-dimensional effect is an effect for allowing an observer to 
recognize an image with a stereoscopic effect by applying an image 
having parallax to both eyes of the observer. 

[0006] It is desired that an even simple text is expressed as an 
impressive text by using such the three-dimensional effect. For 
example, it is desired that in a case that there is a text file created 
with a word processor, etc., certain characters in such the file are 
stereoscopically viewed. In addition, it is desired that in a case 
that there is a file composed of the characters only, or the 
characters and the images (a bitmap image, a GIF image, a JPEG 
image, etc.), certain characters and image portion in such the file 
are stereoscopically viewed. 

[0007] In view of the above circumstances, an object of the 
present invention is to provide a stereoscopic image display 
apparatus and a program, capable of displaying stereoscopically a 
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certain character and image portions based on a file such as a text 
file created with a word processor, an HTML file, etc. In addition, 
an object of the present invention is to provide a text data 
processing apparatus, a program, and a storing medium storing the 
program, capable of readily displaying, when electronic character 
data in which a three-dimensional effect is produced on a character 
or a string of characters is transmitted by electronic mail, etc., 
such the electronic text data in a two-dimensional manner and 
without ruining an intention of a text creator, even in a case that a 
display apparatus on a receiver side is not provided with a function 
for performing a three-dimensional display. 

[0008] In addition, on the contrary, an object of the present 
invention is to provide a text data processing apparatus, a program, 
and a storing medium storing the program, capable of performing a 
text display more impressive than a conventional two-dimensional 
display, by appropriately producing the three-dimensional effect on 
a two-dimensional display-use ordinary character or a string of 
characters in a display apparatus provided with a three-dimensional 
display function. 

MEANS FOR SOLVING THE PROBLEM 

[0009] A stereoscopic image display apparatus according to 
the present invention is a stereoscopic image display apparatus for 
generating a stereoscopic image based on a file, and comprises a 
means for determining a description indicating a stereoscopic 
viewing-use process out of descriptions in a file, a means for 
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determining a phase deviation amount and a deviation direction of 
an object to be stereoscopically displayed based on the description 
indicating the stereoscopic viewing-use process, and a means for 
carrying out a rendering process of each viewpoint image of the 
object to be stereoscopically displayed based on the phase 
deviation amount and the deviation direction (Hereinafter, referred 
to as a first configuration in this section). 

[0010] In a stereoscopic image display apparatus according to 
the above first configuration, the object to be stereoscopically 
displayed may be rendered over an object adjacent thereto, or the 
object adjacent thereto may be rendered over the object to be 
stereoscopically displayed corresponding to the phase deviation 
amount and the deviation direction. In addition, the object to be 
stereoscopically displayed, which is to be rendered over, may be 
rendered in such a manner as to be translucent. The 
rendering-over process may be executed when there is in the file a 
description indicating that the rendering-over process is to be 
carried out. 

[0011] Furthermore, in a stereoscopic image display 
apparatus according to the above first configuration, regarding 
each viewpoint image of the object to be stereoscopically displayed, 
an object on an adjacent side of the object to be stereoscopically 
displayed may be rendered in such a manner that a location thereof 
is deviated toward a side of the deviation direction of the object to 
be stereoscopically displayed only by an amount equal to or larger 



6 



than the phase deviation amount. In addition, a rendering process 
in which the location of the object on the adjacent side is deviated 
may be executed when there is in the file a description indicating 
that the rendering process in which the location of the object on the 
adjacent side is deviated is to be carried out. 

[0012] In a stereoscopic image display apparatus according to 
these configurations, in a case that extent information as 
information indicating the phase deviation amount is described in 
the file, the phase deviation amount may be calculated based on 
information of a previously retained setting table and the extent 
information. In addition, in a case that the object to be 
stereoscopically displayed is stereoscopically displayed on a near 
side, the object to be stereoscopically displayed may be expanded 
and rendered, and in a case that the object to be stereoscopically 
displayed is stereoscopically displayed on a far side, the object to 
be stereoscopically displayed may be reduced in size and rendered. 

[0013] Furthermore, a program according to the present 
invention enables a computer to function as a means for 
determining a description indicating a stereoscopic viewing-use 
process out of descriptions in a file, a means for determining a 
phase deviation amount and a deviation direction of an object to be 
stereoscopically displayed based on the description indicating the 
stereoscopic viewing-use process, and a means for carrying out a 
rendering process of each viewpoint image of the object to be 
stereoscopically displayed based on the phase deviation amount 
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and the deviation direction (Hereinafter, referred to as a second 
configuration in this section). 

[0014] In a program according to the above second 
configuration, it may be possible to enable a computer to function 
as a means for rendering the object to be stereoscopically displayed 
over an object adjacent thereto, or rendering the object adjacent 
thereto over the object to be stereoscopically displayed 
corresponding to the phase deviation amount and the deviation 
direction. In addition, it may be possible to enable a computer to 
function as a means for rendering the object to be stereoscopically 
displayed, which is to be rendered over, in such a manner as to be 
translucent. In addition, it may be possible to enable a computer 
to function as a means for executing the rendering-over process 
when there is a description indicating the rendering-over process in 
a file. 

[0015] . Furthermore, in a program according to the above 
second configuration, it may be possible to enable a computer to 
function as a means for rendering a location of an object on an 
adjacent side of the object to be stereoscopically displayed in such 
a manner as to be deviated toward a side of the deviating direction 
of the object to be stereoscopically displayed only by an amount 
equal to or larger than the phase deviation amount, regarding each 
viewpoint image of the object to be stereoscopically displayed. 
In addition, it may be possible to enable a computer to function as 
a means for executing a rendering process in which the location of 
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the object on the adjacent side is deviated when there is in a file a 
description indicating that the rendering process in which the 
location of the object on the adjacent side is deviated is to be 
carried out. 

[0016] In a program according to these configurations, it may 
be possible to enable a computer to function as a means for 
calculating, in a case that extent information as information 
indicating the phase deviation amount is described in the file, the 
phase deviation amount based on information of a previously 
retained setting table and the extent information. In addition, it 
may be possible to enable a computer to function as a means for 
expanding and rendering the object to be stereoscopically 
displayed in a case that the deviation direction is set so that the 
object to be stereoscopically displayed is stereoscopically 
displayed on a near side, and reducing in size and rendering the 
object to be stereoscopically displayed in a case that the deviation 
direction is set so that the object to be stereoscopically displayed 
is stereoscopically displayed on a far side. 

[0017] In order to solve the above-described problems, a 
stereoscopic image display apparatus according to the present 
invention is a stereoscopic image display apparatus for generating 
a stereoscopic image based on a file, and comprises a means for 
determining whether or not there is attribute information 
indicating a stereoscopic viewing-use process regarding each 
character in the file, a means for determining a phase deviation 
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amount and a deviation direction of a character to be 
stereoscopically displayed based on the attribute information, and 
a means for carrying out a rendering process of each viewpoint 
image of the character to be stereoscopically displayed based on 
the phase deviation amount and the deviation direction 
(Hereinafter, referred to as a third configuration in this section). 

[0018] In a stereoscopic image display apparatus according to 
the above-described third configuration, an image of a shade of the 
character to be stereoscopically displayed may be rendered. In 
addition, when the character to be stereoscopically displayed is 
viewed on a nearer side, a shade may be rendered in such a manner 
that a location thereof is more greatly deviated. In addition, the 
shade may be rendered by the same color system of the character to 
be stereoscopically displayed, and by saturation and/or intensity 
different therefrom. Furthermore, when the character to be 
stereoscopically displayed is viewed on a nearer side, the character 
to be stereoscopically displayed may be rendered larger. In 
addition, when the character to be stereoscopically displayed is 
viewed on a nearer side, the character to be stereoscopically 
displayed may be rendered so that intensity of the color of the 
character to be stereoscopically displayed is more enhanced. 
Furthermore, in a case that the character to be stereoscopically 
displayed is a character with a strike-through, each viewpoint 
image of the strike-through may be rendered so that the 
strike-through is viewed on a nearer side than the character to be 
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stereoscopically displayed. In addition, the strike-through of the 
character to be stereoscopically displayed may be rendered by any 
one of a shaded line, a depth line, a waveform line, or a dashed 
line. 

[0019] Furthermore, software according to the present 
invention enables a computer to function as a means for 
determining whether or not there is attribute information 
indicating a stereoscopic viewing-use process regarding each 
character in a file, a means for determining a phase deviation 
amount and a deviation direction of a character to be 
stereoscopically displayed based on the attribute information, and 
a means for carrying out a rendering process of each viewpoint 
image of the character to be stereoscopically displayed based on 
the phase deviation amount and the deviation direction 
(Hereinafter, referred to as a fourth configuration in this section). 

[0020] In a program according to the above-described fourth 
configuration, it may be possible to enable a computer to function 
as a means for rendering an image of a shade of the character to be 
stereoscopically displayed. In addition, it may be possible to 
enable a computer to function as a means for rendering a shade in 
such a manner that a location thereof is greatly deviated, when the 
character to be stereoscopically displayed is viewed on a nearer 
side. Furthermore, it may be possible to enable a computer to 
function as a means for rendering the shade by the same color 
system of the character to be stereoscopically displayed, and by 
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saturation and/or intensity different therefrom. In addition, it 
may be possible to enable a computer to function as a means for 
rendering the character to be stereoscopically displayed larger, 
when the character to be stereoscopically displayed is viewed on a 
nearer side. Furthermore, it may be possible to enable a computer 
to function as a means for rendering the character to be 
stereoscopically displayed so that intensity of the color of the 
character to be stereoscopically displayed is more enhanced, when 
the character to be stereoscopically displayed is viewed on a nearer 
side. In addition, it may be possible to enable a computer to 
function as a means for rendering, in a case that the character to be 
stereoscopically displayed is a character with a strike-through, 
each viewpoint image of the strike-through so that the 
strike-through is viewed on a nearer side than the character to be 
stereoscopically displayed. Furthermore, it may be possible to 
enable a computer to function as a means for rendering the 
strike-through of the character to be stereoscopically displayed by 
any one of a shaded line, a depth line, a waveform line, or a dashed 
line. 

[0021] Furthermore, the invention according to claim 33 
relates to a text data processing apparatus, and comprises a 
conversion rule storing means for storing a conversion rule for 
converting attribute information on a character or a string of 
characters into another attribute information, an attribute 
searching means for searching from text data the character or the 
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string of characters having the attribute information corresponding 
to the conversion rule, and an attribute conversion means for 
converting according to the conversion rule the attribute 
information on the character or the string of characters searched by 
the attribute searching means, in which the conversion rule 
includes a rule for converting attribute information for producing a 
three-dimensional stereoscopic display effect on the character or 
the string of characters into attribute information for producing a 
certain decoration of a two-dimensional character effect. 

[0022] The invention according to claim 34 relates to a text 
data processing apparatus according to claim 33, in which the 
conversion rule includes a rule for converting the attribute 
information for producing the three-dimensional stereoscopic 
display effect into attribute information for producing a 
two-dimensional character decoration effect approximate to a 
stereoscopic display such as an italic character, a shaded character, 
etc. 

[0023] The invention according to claim 35 relates to a text 
data processing apparatus according to claim 33 or 34, in which the 
conversion rule includes a rule for changing a font size of a 
two-dimensional character corresponding to a level of the 
three-dimensional stereoscopic display effect. 

[0024] The invention according to claim 36 is a text data 
processing apparatus, and comprises a conversion rule storing 
means for storing a conversion rule for converting attribute 
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information on a character or a string of characters into another 
attribute information, an attribute searching means for searching 
from text data the character or the string of characters having the 
attribute information corresponding to the conversion rule, and an 
attribute conversion means for converting according to the 
conversion rule the attribute information on the character or the 
string of characters searched by the attribute searching means, in 
which the conversion rule includes a rule for converting attribute 
information for producing a certain decoration of a 
two-dimensional character effect on the character or the string of 
characters into attribute information for producing a 
three-dimensional stereoscopic display effect. 

[0025] The invention according to claim 37 is a text data 
processing apparatus according to claim 36, in which the 
conversion rule includes a rule for converting attribute information 
for producing a two-dimensional character decoration effect 
approximate to a stereoscopic display such as an italic character, a 
shaded character, etc., into attribute information for producing a 
three-dimensional stereoscopic display effect. 

[0026] The invention according to claim 38 is a text data 
processing apparatus according to claim 36 or 37, in which the 
conversion rule includes a rule for changing a level of the 
three-dimensional stereoscopic display effect corresponding to a 
font size of a two-dimensional character. 

[0027] The invention according to claim 39 is a program for 
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providing a computer with a text data conversion function, and 
comprises a conversion rule table for converting attribute 
information on a character or a string of characters into another 
attribute information, an attribute searching process for searching 
from text data the attribute information on a character or the string 
of characters having the attribute information corresponding to the , 
conversion rule, an attribute conversion process for converting 
according to the conversion rule the attribute information on the 
character or the string of characters searched by the attribute 
searching process, in which the conversion rule table includes a 
rule for converting attribute information for producing a 
three-dimensional stereoscopic display effect on the character or 
the string of characters into attribute information for producing a 
certain decoration of a two-dimensional character effect. 

[0028] The invention according to claim 40 is a program 
according to claim 39, in which the conversion rule table includes a 
rule for converting the attribute information for producing the 
three-dimensional stereoscopic display effect into attribute 
information for producing a two-dimensional character decoration 
effect approximate to a stereoscopic display such as an italic 
character, a shaded character, etc. 

[0029] The invention according to claim 41 is a program 
according to claim 39 or 40, in which the conversion rule table 
includes a rule for changing a font size of a two-dimensional 
character corresponding to a level of the three-dimensional 
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stereoscopic display effect. 

[0030] The invention according to claim 42 relates to a 
program for providing a computer with a text data conversion 
function, and comprises a conversion rule table for converting 
attribute information on the character or the string of characters 
into another attribute information, an attribute searching process 
for searching from text data the character or the string of 
characters having the attribute information corresponding to the 
conversion rule, and an attribute conversion means for converting 
according to the conversion rule the attribute information on the 
character or the string of characters searched by the attribute 
searching process, in which the conversion rule table includes a 
rule for converting attribute information for producing a certain 
decoration of a two-dimensional character effect on the character 
or the string of characters into attribute information for producing 
a three-dimensional stereoscopic display effect. 

[0031] The invention according to claim 43 is a program 
according to claim 42, in which the conversion rule table includes a 
rule for converting attribute information for producing a 
two-dimensional character decoration effect approximate to a 
stereoscopic display such as an italic character, a shaded character, 
etc., into attribute information for producing a three-dimensional 
stereoscopic display effect. 

[0032] The invention according to claim 44 is a program 
according to claim 42 or 43, in which the conversion rule table 
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includes a rule for changing a level of the three-dimensional 
stereoscopic display effect corresponding to a font size of a 
two-dimensional character. 

[0033] The invention according to claim 45 is a storing 
medium for storing a program according to any one of claims 39 to 
44. 

[0034] According to the present invention, it is possible to 
stereoscopically display an arbitrary character and image portions 
based on a file such as an HTML file. In addition, according to 
the present invention, it is possible to stereoscopically display an 
arbitrary character portion based on attribute information on a 
character described in a file. 

[0035] The invention according to claim 33 or 39 is a text 
data processing apparatus for converting the attribute information 
on a character or a string of characters on which a 
three-dimensional effect is produced into the attribute information 
for producing a certain two-dimensional character decoration so as 
to reconstruct text data, so that it is possible for even a display 
apparatus not being provided with a three-dimensional function to 
appropriately emphasize and display the character or the string of 
characters. Therefore, it is possible to smoothly 
two-dimensionally display text data including the character or the 
string of characters on which the three-dimensional effect is 
produced without ruining an intention of a text creator. 

[0036] In addition, according to the invention according to 
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claim 34 or 40, it is possible to display the character or the string 
of characters on which the three-dimensional effect is produced in 
a two-dimensional character decoration manner approximate to a 
three-dimensional effect, and thus, it becomes possible to 
two-dimensionally display these characters in a manner further 
approximate to an intention of a text creator.' 

[0037] Furthermore, according to the invention according to 
claim35 or 41, a font size of a two-dimensional character is 
changed corresponding to a level of the three-dimensional 
stereoscopic effect, so that it is possible to further emphasize the 
character or the string of characters on which the 

three-dimensional effect is produced, and thus, it becomes possible 
to further bring a display state to an intention of a text creator. 

[0038] The invention according to claim 36 or 42 is a text 
data processing apparatus for converting the attribute information 
for producing a certain decoration of a two-dimensional character 
effect into the attribute information for producing a 
three-dimensional character decoration effect so as to reconstruct 
text data, so that even in a display apparatus provided with a 
three-dimensional display function, it is possible to display the 
character or the string of characters in a manner more impressive 
than an ordinary two-dimensional display, and thus, it becomes 
possible to carry out a text display in which an intention of an text 
creator is further emphasized. 

[0039] In addition, according to the invention according to 
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claim 37 or 43, it is possible to display in a three-dimensional 
manner the character or the string of characters on which a 
two-dimensional character decoration effect approximate to a 
three-dimensional effect is produced, and thus, it is possible to 
more appropriately emphasize an intention of a text creator. 

[0040] Furthermore, according to the invention according to 
claim 38 or 44, a depth of the three-dimensional effect is 
appropriately changed corresponding to a font size of the 
two-dimensional character, so that it is possible to produce a 
three-dimensional effect corresponding to the font size, and thus, it 
becomes possible to more appropriately emphasize an intention of a 
text creator. 

[0041] It is noted that the invention according to claim 45 is 
considered as a storing medium. Therefore, in the invention 
according to claim 45, too, it is possible to exhibit the same effect 
as described above. 

[0042] Other effects exhibited in the present invention will 
become more apparent from the following detailed description of 
the embodiments described below. 

BEST MODE FOR PRACTICING THE INVENTION 

[0043] The features of the present invention will become 
more apparent from the following detailed description. However, 
the following embodiment is therefore to be considered in all 
respects as illustrative and not restrictive, and the invention may 
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be embodied in other specific forms without departing from the 
spirit or essential characteristics thereof. 

[0044] Hereinafter, a stereoscopic image display apparatus 
and a program of the present invention will be described based on 
Figure 1 to Figure 13. 

[0045] Figure 1 shows one example of architecture of a 
personal computer (stereoscopic image display apparatus). A 
CPU (central processing unit) 1 is connected to a north bridge 2 
having a system control function, and a south bridge 3 having 
interface functions such as a PCI bus, an ISA bus, etc. To the 
north bridge 2, a video card 5 is connected via a memory 4, and an 
AGP (Accelerated Graphics Port). In addition, to the south bridge 
3, a USB (Universal Serial Bus) interface 6, a hard disk drive 
(HDD) 7, a CD-ROM device 8, etc., are connected. 

[0046] Figure 2 shows a generally used video card 5. In 
receipt of an instruction from the CPU 1 via the AGP, a VRAM 
(video memory) controller 5b controls writing rendering data into a 
VRAM 5a and reading out the same from the VRAM 5a. A DAC 
(D/A (digital to analog) converter) 5c converts digital video data 
from the VRAM controller 5b into an analog video signal, and 
supplies this video signal to a personal computer-use monitor 12 
via a video buffer 5d. In such a video display process (rendering 
process), a right-eye image and a left-eye image are generated, and 
these images are alternately rendered in a vertical stripe shape, and 
so forth. As a result, a stereoscopic image display process is 
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carried out. 

[0047] The personal computer is provided with Internet 
connection environment, and is capable of receiving an HTML file 
or an XML file (for example, a text file, electronic mail, the HTML 
file, the XML file, etc.)* for example, from a transmission-side 
device configured to be a server on the Internet, etc. In addition, 

> 

as a result of being provided with a liquid crystal barrier on the 
above-described monitor 12, for example, the personal computer 
becomes possible to perform both a non-stereoscopic image display 
and a stereoscopic image display. If stereoscopic images are 
formed by alternately arranging the right-eye images and the 
left-eye images in a vertical stripe shape, for example, a control of 
the CPU 1 forms a light-shielding area in the vertical stripe shape 
in the liquid crystal barrier. Furthermore, if the stereoscopic 
images are displayed in one portion of a screen (a window portion 
where a file is reproduced, or one image portion in the HTML file), 
it is possible to control by the CPU 1 a size and a location where 
the light-shielding area in the vertical stripe shape is formed based 
on the coordinates and a size of the window or one image portion. 
In addition to the liquid crystal barrier, it may be possible to use a 
normal barrier (having a barrier stripe formed fixedly at a 
predetermined pitch). Furthermore, since the personal computer 
mounts browser software (viewer), the personal computer (viewer) 
is capable of opening the file, and displaying the same on the 
monitor 12. 
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[0048] Next, a stereoscopic viewing-use rendering process of 
a file by the personal computer (browser software) will be 
described based on Figure 3 to Figure 4. Figure 3 shows a display 
example of a sentence of "ABCDEFGHIJKL", a portion (a) of 
Figure 3 shows an example of a non-stereoscopic display, and 
portions (b), (c) of Figure 3 show an example of a stereoscopic 
display of a pictographic-character portion of "G" (where "G" 
looks as if to be protruded toward an observer). As the portion 
(b) of Figure 3 shows, the pictographic-character portion of "G" is 
deviated to a right side by certain pixels in order to serve as the 
left-eye image (as a result of "G" being deviated, a portion of "H" 
is hidden (eroded)), and the pictographic-character portion of "G" 
is deviated to a left side by certain pixels in order to serve as the 
right-eye image (as a result of "G" being deviated, a portion of "F" 
is hidden (eroded)). Herein, a deviation amount of the 
pictographic-character portion of "G" is calculated based on a 
description in the file, and left eye-use display data (ABCDEF 
GIJK) in the portion (b) of Figure 3 and right eye-use display data 
(ABCDEG HIJKL) are generated. A starting location of the 
description of "ABCDEFGHIJKL" is described in the file, and is 
specified by an X coordinate indicated by <start x>100</start x> 
and a Y coordinate indicated by <start y>50</start y>, for example. 
In addition, carried out is a writing process in which pixel data 
composing the left eye-use display data (ABCDEF GIJK), and pixel 
data composing the right eye-use display data (ABCDEG HIJKL) 
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are alternately written from a pixel data storing location of the 
VRAM corresponding to the coordinates (that is, one pixel of right 
eye-use pixels and one pixel of left eye-use pixels are alternately 
written in a horizontal direction as a display image). It is noted 
that the portion (c) of Figure 3 shows a display example in which a 
portion that "G" and "H" are superposed and a potion that "G" and 
"F" are superposed are translucent. In order to compose the 
image in such a manner as to be translucent, it may be possible to 
carry out a process in which a 1/2 (half) value of one image data 
and a 1/2 (half) value of the other image data are added is 
evaluated, and the evaluated value is used as the image data. 

[0049] Figure 4 shows a display example of a sentence such as 
"ABCDEFGHI JK", a portion (a) of Figure 4 shows an example of a 
two-dimensional display, and a portion (b) of Figure 4 shows an 
example of a stereoscopic display of a portion "EF" (where "EF" 
look as if to be protruded toward an observer). In the portion (b) 
of Figure 4, as a result of "GHIJK", a non-stereoscopically 
displayed portion, being deviated, adjacent characters are 
prevented from being hidden (eroded). 

[0050] A portion (a) of Figure 5 shows a description example 
of a file for the non-stereoscopic display of a sentence such as 
"ABCDEFGHIJK", a portion (b) of Figure 5 shows a description 
example of a file for a stereoscopic display of a portion "EF" in a 
sentence of "ABCDEFGHIJK" (not eroded). The personal 
computer (browser software) determines a description portion 
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indicating a stereoscopic viewing-use process in descriptions in 
the file. In the example of Figure 5, the personal computer 
determines that a portion sandwiched by <3d> and </3d> is the 
description portion indicating that the stereoscopic viewing-use 
process is to be carried out, and in addition, determines a phase 
deviation amount and a deviation direction of objects to be 
stereoscopically displayed (characters to be stereoscopically 
displayed, images to be stereoscopically displayed) based on the 
description portion indicating that the stereoscopic viewing-use 
process is to be carried out. In the example of the portion (b) of 
Figure 5, the personal computer recognizes that the portion "EF" is 
the characters to be stereoscopically displayed. Furthermore, 
there is a description of <zurasi L X>8</zurasi L X>, and based on 
this description, the personal computer determines that the phase 
deviation amount of the left eye-use characters is eight pixels to a 
right side. In addition, there is a description of <zurasi R X>, 
</zurasi R X>, and based on this description, it is possible to 
similarly define the deviation amount of the right eye-use 
characters. However, this definition is herein omitted (not 
described in reality). Therefore, the personal computer 
determines that deviation amount is a default value (0 (zero)). 
Based on the phase deviation amount and the deviation direction 
thus determined, the personal computer carries out a right eye-use 
image rendering and a left eye-use image rendering of the 
characters to be stereoscopically displayed. It is noted that this 
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example is an example where there is no erosion, and the personal 
computer (browser software) carries out a rendering process where 
a location of the objects (characters or image) on an adjacent side 
of the object to be stereoscopically displayed is deviated to a side 
of the deviation direction of the object to be stereoscopically 
displayed by an amount equal to or larger than the phase deviation 
amount. In the example of the portion (b) of Figure 5, based on a 
description of <zurasi X>, </zurasi X> (this description is omitted 
in reality. In such the case, a value of <zurasi L X>, that is, 8 is 
set) described after "GHIJK", the personal computer carries out a 
rendering process where all characters of "GHIJK" are shifted by 
eight pixels to a right side. 

[0051] Thus, the personal computer (browser software) 
determines the object to be stereoscopically displayed, the phase 
deviation amount, and the deviation direction according to 
meanings of the above descriptions so as to carry out the right 
eye-use image rendering process and the left eye-use image 
rendering process. 

[0052] It is noted that it is needed that the phase deviation 
amounts of the portion to be non-stereoscopically displayed 
(GHIJK) are made equal between the left eye-use image and the 
right eye-use image. The deviation amount of the portion to be 
stereoscopically displayed (EF) is to be changed corresponding to a 
protruding amount (or a depth amount). In addition, the deviation 
amount of the portion to be stereoscopically displayed and that of 
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the portion to be non-stereoscopically displayed may be different. 
However, it is needed that "the phase deviation amount of the 3D 
(three-dimensionally) displayed portion" is equal to or smaller 
than ) "the phase deviation amount of 2D (two-dimensionally) 
displayed portion". Otherwise, the erosion is to be occurred. In 
addition, in order to carry out the stereoscopic display of each 
object ("E" "F") more effectively, it may be possible that each 
object is separated (in the above example, "E" and "F"), and the 
phase deviation amounts are applied to each of the objects. 

[0053] Figure 6 shows another description example (presence 
or absence of the erosion is displayed by tags). The tags of 
<shift>8 </shift> indicate that relative phase deviation amounts of 
the left eye-use image and the right eye-use image are + (plus) 8. 
The tags of <overlap> YES</overlap> define that there is the 
erosion. 

[0054] The relative phase deviation amounts of the left 
eye-use image and the right eye-use image 

+ (positive: protruding): deviate the left eye-use characters 
to right relative to the right eye-use characters (deviate eight 
pixels). 

- (negative: depth): deviate the right eye-use characters to 
right relative to the left eye-use characters (deviate eight pixels). 
[0055] Whether there is the erosion or not 

Yes: deviate "EF" equally to right and left sides (deviate by 
each four pixels). 
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Not deviate "GHIJK". 

No: deviate "EF" to right only (deviate by eight pixels). 

Deviate "GHIJK" to right (deviate eight pixels) by the same 
value (absolute value) as the relative phase deviation amount of the 
right eye-use and left eye-use characters. That is, the personal 
computer (browser software) determines the characters to be 
stereoscopically displayed, the phase deviation amount, and the 
deviation direction according to the meanings of the above 
descriptions so as to carry out the right eye-use image rendering 
process and the left eye-use image rendering process. 

[0056] Figure 7 shows another description example (the 
protruding amount is shown by a level). 
[0057] Stereoscopic direction 

Protruding: deviate the left eye-use characters to right 
relative to the right eye-use characters. 

Depth: deviate the right eye-use characters to left relative to 
the left eye-use characters. 

[0058] A relative phase deviation level of the right eye-use 
and left eye-use characters 

A relationship between the level and the number of pixels is 
defined. A specific number of pixels corresponding to the 
definition is previously stored in a memory of the personal 
computer as a setting table. 

Strong: deviate eight pixels 

Medium: deviate four pixels 
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Weak: deviate two pixels 
[0059] Whether there is the erosion or not 

Yes: deviate "EF" equally to right and left sides (deviate by 
each four pixels). 
Not deviate "GHIJK". 

No: deviate "EF" to right only (deviate by eight pixels) 

Deviate "GHIJK" to right (deviate by eight pixels) by the 
same value (absolute value) as the relative phase deviation amount 
of right eye-use and left eye-use characters. That is, the personal 
computer (browser software) determines the stereoscopically 
displayed-characters, the phase deviation amount, and the 
deviation direction according to the meanings of the above 
descriptions so as to carry out the right eye-use image rendering 
process and the left eye-use image rendering process. 

[0060] Figure 8 shows another description example 
(protruding amount is expressed by a ratio). The tags of <shift 
ratio>60</shift ratio> indicate that a relative phase deviation ratio 
of the right eye-use image and the left eye-use image is 60 %. 
[0061] Stereoscopic direction 

Protruding: deviate the left eye-use image to right relative 
to the right eye-use image. 

Depth: deviate the right eye-use image to right relative to 
the left eye-use image. 

[0062] A maximum value of the relative phase deviation of 
the right eye-use and left eye-use characters is 10. This 
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information is previously stored in the memory of the personal 
computer as the setting table. 

[0063] N %: deviate by 10 • N/100 pixels (if N is equal to ( = ) 
60, then, deviate by six pixels). Numerals after the decimal point 
are rounded down or up to a nearest integer number. 

The maximum value may be specified by the user, or the 
display information may serve as the maximum value (that is, the 
maximum value differs depending on a size of a display). 
[0064] Whether there is the erosion or not. 

Yes: deviate "EF" equally to right and left (deviate by each 
three pixels). 

Not deviate "GHIJK". 

No: deviate "EF" to right only (deviate by each six pixels) 
Deviate "GHIJK" to right (deviate six pixels) by the same 
value (absolute value) as the relative phase deviation amount of 
right eye-use and left eye-use characters. That is, the personal 
computer (browser software) determines the stereoscopically 
displayed-characters, the phase deviation amount, and the 
deviation direction according to the meanings of the above 
descriptions so as to carry out the right eye-use image rendering 
process and the left eye-use image rendering process. 

[0065] Figure 9 shows another description example (shows a 
movement). 

[0066] Movement 

Backward and forward: start from a reference phase 
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deviation amount, and move backwardly and forwardly in a 
reciprocating manner between a maximum phase deviation amount 
and a minimum phase deviation amount. 

Right and left: start from a middle position of moveh by the 
reference phase deviation amount, and move to right and left in a 
reciprocating manner. 

From left to right: move from left to right, and when reached 
to right, start moving from left once again (movement amount is 
moveh). 

From right to left: move from right to left, and when reached 
to left, start moving from right once again (movement amount is 
move_h) . 

Rotation: start from a state that the character faces toward 
the user in a non-stereoscopic manner (2D), and rotate according to 
a supplemental description described later. 

Rest: rest at the reference phase deviation amount (no 
movement) 

Besides, also possible to move from forward to backward, 
and from backward to forward. 

[0067] The number of times of movements 

Display the movements of a designated number of times, 
return to a start state, and suspend. In a case that 0 (zero) is 
designated, repeat infinitely. 

[0068] Whether there is the erosion or not. 
Yes: deviate "EF" equally to right and left. 
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Not deviate "GHIJK". 

No: deviate "EF" to right only. 

Deviate "GHIJK" to right by the largest value, out of 
absolute values of typ_shift, max shift, and min shift. In a case 
of moving to right and left, move h is further added on the largest 
value. 

[0069] It is noted that the tags to be used change depending 
on kinds of movements, so that in a case that unnecessary tags are 
described, the personal computer (browser software) ignores the 
unnecessary tags. 

[0070] Complement 1: a method of rotation 

The easiest method of realizing the rotation is a method in 
which a normal rotation of the characters is used and the rotated 
characters are taken out by different angles. It can be said that 
characters to be rotated as shown in Figure 10 is a graphic form of 
the characters "EF" viewed from different angles, so that it 
becomes possible to stereoscopically view the characters as a 
result of two graphic forms of characters having slightly different 
angles being the right and left images. At this time, there exists a 
protruding portion and a depth portion in the characters of "EF", so 
that the phase deviation amount changes depending on a region 
(pixel) of the characters. Out of these changing states, a state 
having the strongest parallax is specified by max shift, and 
min_shift. Based upon this value, it is possible to determine a 
rendering location of the region of the characters. 
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[0071] Complement 2: a stereoscopic method 

The above cases are achievable in every stereoscopic method. 
In a case that the number of viewpoints is larger than 2, or in a case 
of four viewpoints, for example, the phase deviation amounts of a 
first viewpoint character, a second viewpoint character, a third 
viewpoint character, and a fourth viewpoint character are 
determined. In addition, in a case of multi- viewpoints, a process 
of not allowing the characters to be eroded may differ. In a case 
of four viewpoints, "GHIJK" is deviated only by deviated amounts 
of the first viewpoint character and the fourth viewpoint character 
(the relative phase deviation amount of right eye-use and left 
eye-use characters • (times) 3). However, it is noted that thus, a 
composing process, and a process at a time that there is the erosion 
change depending on the kinds of the stereoscopic methods or the 
number of viewpoints, so that such information may be applied in 
advance. It is possible to apply a content for the composing 
process by a function. 

[0072] That is, the personal computer (browser software) 
determines the characters to be stereoscopically displayed, the 
phase deviation amount, the deviation direction, etc., according to 
the meanings of the above descriptions, information on the number 
of viewpoints, the function, etc., so as to carry out rendering 
processes of the first viewpoint character, the second viewpoint 
character, the third viewpoint character, and the fourth viewpoint 
character. 
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[0073] A portion (a) of Figure 11 shows another description 
example (whether or not there is the erosion, and a level of 
transparency are expressed by the tags), and a portion (b) of Figure 
11 shows a descriptive diagram showing a rendering process. 

[0074] Relative phase deviation amount of right eye-use and 
left eye-use characters 

+ (positive: protruding): deviate the left eye-use characters 
to right relative to the right eye-use characters (deviate by eight 
pixels). 

- (negative: depth): deviate the right eye-use characters to 
right relative to the left eye-use characters (deviate by eight 
pixels). 

[0075] Whether or not there is the erosion (<overlap>) 

Yes: deviate the pictographic character equally to right and 
left (deviate by each four pixels). 
Not deviate "GHIJK". 

No: deviate the pictographic character to right only (deviate 
by eight pixels). 

Deviate "GHIJK" to right by the same value (absolute value) 
as the relative phase deviation amount of the right eye-use and left 
eye-use characters (deviate by eight pixels). 
[0076] Priority of display (<priority>) 

1: display in such a manner that the characters to be 
stereoscopically displayed are placed on an upper layer 

(non-stereoscopically displayed characters to be eroded are 



33 



hidden) 

2: display in such a manner that the characters to be 
stereoscopically displayed are placed on a lower layer 
0: depend on a browser (player) for displaying 
In a case that these tags are not set (default), the value is 0 

(zero) 

[0077] According to the level of transparency 
(<transparency>M</transparency>) being described, the level of 
transparency of the characters (pictographic characters) to be 
displayed is set by M %. In a case of a default (when the setting 
is not made), the level of transparency is 0 (zero) %. For example, 
if data of an R pixel of an object to be specified as transparent is 
Rl, and data of the R pixel of an object overlapped thereon is R2, it 
is possible to calculate rendering R pixel data as in (R2 • M/100 + 
Rl • (l-M/100)). 

[0078] Incidentally, in a case of stereoscopically viewing the 
object as if to be protruding, as Figure 12 shows, a sensory 
character width F is smaller than an original character width D. 
For overcoming this, in a case that the characters are 
non-stereoscopically displayed according to a character size 
described in the file (specified sized character), a fabricating 
process in which the browser doubles in size the characters of "EF", 
which are to be stereoscopically displayed, for example, is 
executed on the string of a characters shown in a portion (a) of 
Figure 13. After this process, the rendering processes of the right 



34 



eye-use image and the left eye-use image (phase deviation process) 
are to be carried out. In a case of the setting that there is no 
erosion, a phase of "GHIJK", too, is to be deviated as shown in a 
portion (b) of Figure 13. On the other hand, in a case of the 
setting that there is the erosion, a rendering process is carried out 
as shown in a portion (c) of Figure 13. 

[0079] As shown in Figure 12, there is a relationship that D: 
(A + B) is equal to ( = ) F:B, C:A is equal to ( = ) E:B, and this leads 
to F/D equal to ( = ) E/(E + C). As a result of the protrusion, the 
characters become E/(E + C)-times (shrink), so that the characters 
are magnified by (E + C)/E-times in advance, and displayed as such. 
E is a fixed number of approximately 65 mm (millimeters). In a 
case that the phase deviation amount that corresponds to a parallax 
amount of C equal to ( = ) 65 mm (millimeters) is set, for example, 
the observer may feel that the characters are reduced to 1/2, so that 
the characters are to be rendered in such a manner as to be doubled 
in size in advance. Herein, the personal computer (browser) 
retains pixel pitch information of the personal computer's monitor 
12. For example, the personal computer has a table on which a 
pixel pitch based on a screen inch size and screen resolution is 
obtained, and as a result of the user inputting the screen inch size 
and the screen resolution, for example, the pixel pitch (mm: 
millimeter) is obtained. The personal computer (browser) 
evaluates the value of (E + C)/E based on C (mm) obtained by 
multiplying the phase deviation amount (the number of pixels) in a 
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file description by the pixel pitch and E equal to ( = ) 65 mm, and 
applies a pixel interpolation (expansion process) to the original 
character based on this value ((E + C)/E). Or, the personal 
computer (browser) determines the character size that satisfies a 
size obtained by multiplying the original character size by the 
value of (E + C)/E, obtains pixel data of "EF" of this character size, 
and renders the characters. At a time of this rendering, the 
personal computer (browser) renders by determining coordinates so a 
that a center the expanded "EF" is placed at the center of upper and 
lower limits of a row of the string of characters. For example, 
when the number of vertical pixels of the original characters is 20, 
and the number of vertical pixels of the expanded characters is 40, 
as a result of an arithmetic operation of (40-20)/2 = 10, the 
personal computer (browser) renders the characters of "EF" by 
deviating downwardly by 10 pixels in a vertical direction relative 
to a reference location (bottom location relative to the row area). 

[0080] It is noted that the above example illustrates the 
personal computer in which the file is recognized and then, the 
image is displayed. However, in addition thereto, the 
stereoscopic image display apparatus may be a digital broadcast 
receiver capable of receiving data broadcast (BML file) and 
displaying the image, a mobile telephone provided with Internet 
connection environment and an image displaying function, and etc. 

[0081] Next, another example of the stereoscopic rendering 
process of the file by the personal computer (viewer) will be 
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described based on Figure 14 to Figure 17. A portion (a) of 
Figure 14 shows a character display example of "S" having a 
non-stereoscopic (2D) character attribute, and a portion (b) of 
Figure 14 shows a character display example of "E" having a 
stereoscopic (3D) character attribute. 

[0082] In the character display example of "E" having the 
stereoscopic (3D) character attribute, not only images of right and 
left viewpoints of the character are rendered, but also a shade of j 
the character is rendered (a shade portion is displayed in a fainter 
manner than the character in the portion (b) of Figure 14). In a 
case of displaying the character of "E" in such a manner as to be 
protruded toward the user, a left eye-use image may be deviated to 
a right side by a certain number of pixels relative to an original 
display location of a character to be displayed, and a right eye-use 
image may be deviated to a left side by a certain number of pixels 
relative to the original display location of the character to be 
displayed. 

[0083] As the phase deviation amount, the number of pixels to 
be deviated in the characters may be described as the character 
attribute information, or a degree of deviating pixels may be 
described. As the degree of deviating pixels, it may be so 
determined on the software that a degree 1 means that the 
characters are deviated only by two pixels, and a degree 2 means 
that the characters are deviated only by four pixels, for example. 
In addition, the phase deviation amount may be determined based 
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on the character size, that is, the character attribute information. 
For example, there is a method for allowing the phase deviation 
amount to be proportional to the character size. In this case, a 
proportional constant number value is retained on a software side, 
and a process for multiplying the character size by this 
proportional constant number value is carried out, and as a result, 
it becomes possible to determine the phase deviation amount. Or, 
a corresponding table of the character size and the phase deviation 
amount may be prepared on the software. 

[0084] Furthermore, regarding the deviation direction, how 
the character is viewed (protruding = 0, depth = 1, etc.,) may be 
retained in the personal computer (viewer) as the character 
attribute. In addition, in rendering the character (character to be 
stereoscopically displayed) and the shade to which the deviation 
process is applied, the personal computer carries out a process in 
which pixel data constituting the left eye-use display data and 
pixel data constituting the right eye-use display data are 
alternately written from the pixel data storing location of the 
VRAM corresponding to rendering coordinates (as the display 
image, one right eye-use pixel and one left eye-use pixel are 
alternately written one after another in a horizontal direction). 

[0085] The shade of the character to be stereoscopically 
displayed may be created in such a manner that a character in the 
same shape as the character to be stereoscopically displayed is 
deviated by a certain number of pixels and rendered in a right-side 
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position of the characters, etc., and is rendered in black or gray, 
etc., for example. Then, in a case that the character to be 
stereoscopically displayed with a shade is rendered, it may be 
possible to carry out a process in which the character to be 
stereoscopically displayed and the shade are set as one, and these 
two are deviated by the same phase, and in addition a process in 

.» 

which the phase deviation amounts of the character to be 
stereoscopically displayed and the shade differ. For example, 
when the left eye-use character is deviated by four pixels to a right 
side relative to the original display location, the shade of this 
character may be deviated by only two pixels to a right side, and 
when the right eye-use character is deviated by four pixels to a left 
side relative to the original display location, the shade of this 
character may be deviated by only two pixels to a left side. 

[0086] The character may own the phase deviation amount in 
rendering the shade as the character attribute. Or, the personal 
computer (viewer) may carry out an arithmetic calculation process 
on its own side so as to generate the phase deviation amount of the 
shade based on the phase deviation amount of the character, that is, 
the phase deviation amount in rendering the shade is made half the 
phase deviation amount of the character, and so forth. 

[0087] Furthermore, in a case that the character to be 
stereoscopically displayed is rendered with the shade, and the 
character to be stereoscopically displayed is protruded toward the 
user, as Figure 15 shows, it may be possible that the shade (shade 
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portion is displayed in a fainter manner than the character in 
Figure 15) is displayed in the original display location of the 
character to be stereoscopically displayed, and only the character 
to be stereoscopically displayed is displayed in such a manner as to 
be deviated. In this case, the shade is viewed as if to be on the 
same plane surface as other non-stereoscopically displayed 
characters, and the character to be stereoscopically displayed is 
viewed as if to be in a location more protruded toward the user tha^i 
the non-stereoscopically displayed characters. 

[0088] Furthermore, in a case of rendering the character to be 
stereoscopically displayed with the shade, as a portion (a) of 
Figure 16 shows, the personal computer (viewer) renders the shade 
of the character to be stereoscopically displayed with the shade in 
such a manner that a location of the shade is deviated greater in a 
case that the character to be stereoscopically displayed is viewed 
on a nearer side than a case that the character to be 
stereoscopically displayed is viewed on a farther side (it is 
possible to determine by the deviation direction and the deviation 
amount). Such the process may be executed by a process in which 
a distance between the character to be stereoscopically displayed 
and the shade is changed corresponding to the phase deviation 
amount in a case that a deviating process in which the character to 
be stereoscopically displayed and the shade are set as one and 
deviated by the same amount is carried out, or as described before, 
carried out is a process in which the location of the shade is viewed 
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to be deviated greatly by applying parallax to the shade itself as a 
result of making the phase deviation amount in rendering the shade 
half the phase deviation amount of the character, and so on. 

[0089] A color of the shade is not limited to black, or grey, 
described above, and it is possible to render the color of the shade 
by changing saturation and/or intensity of the shade by using the 
same color system (the same hue or approximate hue) as the 
character to be stereoscopically displayed. For example, the < 
color of the shade is displayed to be darker or brighter than the 
color of the character to be stereoscopically displayed. In a case 
that an image process is carried out based on RGB, if all of an R 
value, a G value, and a B value are lowered by a certain amount, 
the shade becomes darker, and on the contrary, all of the values are 
made higher by a certain amount, the shade becomes brighter. In 
addition, the shade may be rendered in such a manner that an 
arithmetic calculation process in which the R value, the G value, 
and the B value are converted into HIS (Hue: Saturation: Intensity) 
and the saturation is changed is carried out, and the HIS is once 
again converted into the R value, the G value, and the B value. 
The character may own the character attribute, which is about 
whether the color of the shade is one fixed color or a color 
according to the color of the character. The personal computer 
(viewer) is to carry out a rendering-color selection process based 
on the character attribute. 

[0090] Incidentally, in a case of allowing the character to be 
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stereoscopically displayed as if to be protruded, as Figure 12 
described above shows, the sensory character width F becomes 
smaller than the original character width D. Consequently, 
instead of rendering the character to be stereoscopically displayed 
according to the original character size indicated in the original 
character attribute, a fabricating process for doubling the character 
size is executed, for example. After this process, rendering 
processes (phase deviation process) for the right eye-use image and ; 
the left eye-use image are to be carried out. 

[0091] As shown from Figure 12, there is a relationship that 
D: (A + B) is equal to (=) F:B, C:A is equal to ( = ) E:B, and this 
leads to F/D equal to (=) E/(E + C). As a result of the protrusion, 
the characters become E/(E + C)-times (shrink), so that the 
characters are magnified by (E + C)/E-times in advance, and 
displayed as such. E is a fixed number of approximately 65 mm 
(millimeters). In a case that the phase deviation amount that 
corresponds to a parallax amount of C equal to ( = ) 65 mm 
(millimeters) is set, for example, the user may feel that the 
characters are reduced to 1/2, so that the characters are rendered by 
double in size in advance, and displayed as such. Herein, the 
personal computer (viewer) retains pixel pitch information of the 
personal computer's monitor 12. The personal computer (viewer) 
keeps a table on which a pixel pitch is obtained based on a screen 
inch size and screen resolution, and obtains the pixel pitch 
(millimeters, (mm)) as a result of the user inputting the screen inch 
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size and the screen resolution, for example. 

[0092] The personal computer (viewer) evaluates the value of 
(E + C)/E based on C (mm) obtained by multiplying the phase 
deviation amount (the number of pixels) in the character attribute 
by the pixel pitch and E equal to ( = ) 65 mm, and applies a pixel 
interpolation (expansion process) to the original character based 
on this value ((E + C)/E). Or, the personal computer (viewer) 
determines the character size that satisfies a size obtained by 
multiplying the original character size by the value of (E + C)/E, 
obtains pixel data of "EF" of this character size, and renders the 
characters. At a time of this rendering, the personal computer 
(viewer) renders by determining coordinates so that a center the 
expanded "EF" is placed at the center of upper and lower limits of a 
row of the string of characters. For example, when the number of 
vertical pixels of the original characters is 20, and the number of 
vertical pixels of the expanded characters is 40, as a result of an 
arithmetic operation of (40-20)/2 = 10, the personal computer 
(viewer) renders the characters of "EF" by deviating downwardly 
by 10 pixels in a vertical direction relative to a reference location 
(bottom location relative to the row area). 

[0093] It is noted that in the above process, the sensory width 
of the character to be viewed as if to protrude is the same as the 
original character width. However, as shown in a portion (b) of 
Figure 16, the personal computer (viewer) may execute a process in 
which the larger the protruding amount, the larger a sensory effect 
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of the character than the original size. In addition, the personal 
computer may execute a process in which the larger the depth 
amount, the smaller the sensory effect of the character than the 
original size (thinning-out of pixels constituting the character, 
etc.). 

[0094] Furthermore, as a portion (c) of Figure 16 shows, the 
personal computer (viewer) displays the character in such a manner 
that the larger the protruding amount of the character to be 
stereoscopically displayed, the brighter the character, and the 
larger the depth amount of the character, the darker the character. 
In a case that the image process is carried out based on RGB, if all 
of an R value, a G value, and a B value are lowered by a certain 
amount, the character to be stereoscopically displayed becomes 
darker, and on the contrary, all of the values are made higher by a 
certain amount, the character to be stereoscopically displayed 
becomes brighter. 

[0095] In addition, as shown in a portion (a) of Figure 17, in a 
case that the characters to be displayed are non-stereoscopically 
displayed characters with strike-throughs, the personal computer 
(viewer) renders two horizontal lines placed on "NY", i.e., the 
displayed characters On the other hand, in a case that the 
characters to be displayed are the characters to be stereoscopically 
displayed with strike-throughs, as a portion (b) of Figure 17 shows, 
the personal computer (viewer) renders each viewpoint image of 
the strike-throughs so that the strike-throughs are viewed on a side 
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nearer than the characters to be stereoscopically displayed. For 
example, in a case that left eye-use characters of "NY" are deviated 
by each two pixels to a right side relative to the original display 
location, pixels of the strike-throughs are deviated by four pixels 
to a right side, and in a case that right eye-use characters of "NY" 
are deviated by each two pixels to a left side relative to the 
original display location, pixels of the strike-throughs are deviated 
by four pixels to a left side. The character may own the phase 
deviation amount in rendering the strike-throughs as the character 
attribute. Or, the personal computer (viewer) may carry out an 
arithmetic calculation process on its own side so as to generate the 
deviation amount of the shade based on the phase deviation amount 
of the character, that is, the phase deviation amount in rendering 
the strike-throughs is made half the phase deviation amount of the 
character, and so forth. 

[0096] As a portion (c) of Figure 17 shows, the personal 
computer (viewer) renders the strike-throughs of the characters to 
be stereoscopically displayed by any one of a shaded line, a thick 
line, a waveform line, a dashed line. Compared to a case that a 
simple line is rendered as the strike-though, a case that the 
strike-through is rendered as described above is easier to cause a 
difference to the right and left viewpoint images regarding the 
strike-through, and in addition, a stereoscopic feeling of the 
strike-through is improved. 

[0097] Figure 18 is a descriptive diagram showing a sentence 
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of "I go to NY", and attribute information of each character 
constituting this sentence. Besides normal character attributes 
such as "font", "size", and etc., each character has an attribute of 
"3D display" (Yes/No). In addition, as "3D information", each 
character has attributes such as "protruding/depth" (0/1), 
"deviation degree" (for example, specified by values between 1 to • 
5), "shaded" (Yes/No), "specify shade as a shallow color" (Yes/No), 
"specify a change of shade deviation amount" (Yes/No), "specify a 
change of character brightness" (Yes/No), "specify a change of 
character size" (Yes/No), etc., for example. The personal 
computer (viewer) recognizes the character indicated by "Yes" in 
the "3D display", as the character to be stereoscopically displayed, 
and based on each attribute information of "3D information", 
determines the phase deviation amount and the deviation direction 
according to the meanings of the above attributes as described 
before. Furthermore, the personal computer (viewer) carries out a 
character color change, a character size change, a shade rendering, 
etc., and carries out the rendering processes for the right eye-use 
image and the left eye-use image. 

[0098] It is noted that in a case of allowing a portion of the 
sentence (NY, for example) to be stereoscopically displayed, there 
is a case that the characters to be stereoscopically displayed are 
rendered in such a manner as to be overlapped on a rendering 
location of characters adjacent thereto. Accordingly, in creating 
the sentence, the characters to be stereoscopically displayed and 
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the characters adjacent thereto may be separated widely. 
Needless to say, in a case of recognizing the characters to be 
stereoscopically displayed based on the attribute information, the 
personal computer (word processor, etc.) may automatically 
execute an editing process for widening intervals between the 
character to be stereoscopically displayed and the characters 
adjacent thereto than usual. In addition, a level of transparency 
(M) may be set as an attribute of the characters to be 
stereoscopically displayed. For example, the personal computer 
(word processor, etc.) is capable of obtaining rendering R pixel 
data as a result of an arithmetic calculation as in (R2 - M/100 + Rl 
• (l-M/100)) where data of an R pixel of the character to be 
expanded that is designated to be transparent is Rl, and data of an 
R pixel of a character overlapped thereon is R2. This transparent 
setting may be used for a case that the character to be 
stereoscopically displayed is displayed in a color different from 
other characters. 

[0099] Furthermore, the above example illustrates the 
personal computer in which the file is recognized and then, the 
image is displayed. However, in addition thereto, the 
stereoscopic image display apparatus may be a digital broadcast 
receiver capable of receiving data broadcast (BML file) and 
displaying the image, a mobile telephone provided with Internet 
connection environment and an image displaying function, and etc. 

[0100] As described above, if a three-dimensional effect is 
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produced on the character or the string of characters constituting 
the sentence, a visual effect of the sentence is remarkably 
improved. On the contrary, in a case that electronic text data 
created on such the character or the string of characters on which 
the three-dimensional effect is produced is transmitted by 
electronic mail, etc., and that a display apparatus on a receiver side • 
is not provided with a function for the 3D display, there occurs 

* 

inconvenience that such the electronic text data cannot be readily 
displayed. 

[0101] As described above, the electronic text data is often 
described in a format such as XML, and the above 3D effect is 
realized as a result of the tags being described in the character or 
the string of characters as the attribute information, for example. 
Therefore, if the attribute indicating the 3D effect is deleted from 
the electronic text data, and the attribute of the string of characters 
is changed to an attribute (no attribute is specified) indicating a 
normal two-dimensional display (2D display), it becomes possible 
to display the received electronic text data as a normal string of 
characters even if the apparatus on a receiver side is not provided 
with a corresponding function. However, if this is done, a display 
effect added by a text creator is ruined, and in addition, it is 
probable that an intention of the text creator is not correctly 
transmitted to the receiver side. 

[0102] Hereinafter, another embodiment of the present 
invention will be described by referring to Figures. Firstly, 
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Figure 19 shows a function block of a text conversion processing 
tool relating to the embodiment. 

[0103] It is noted that the function block shown in Figure 19 
is realized if a program or a database for executing each function in 
a coordinating manner is mounted in the apparatus, and the CPU is 
thereby provided with a similar function. Herein, the program 
and the database may be mounted in the apparatus in advance, or, 
may be installed from outside as required. In order to carry out 
such the install, the program and the database may be downloaded 
using a public network such as the Internet, etc., and in addition, 
such the install can be also possible using a method in which a 
storing medium (disk, etc.) that the program and the database is 
stored is attached to the apparatus, and the install is processed 
accordingly. 

[0104] As shown in Figure 19, the text conversion processing 
tool is composed of a text searching portion 201, a text conversion 
portion 202, and a conversion rule retaining portion 203. 

[0105] The text searching portion 201 searches the characters 
or the string of characters to which the certain attributes are added, 
out of input text data Tl, according to a conversion rule table 
retained in the conversion rule retaining portion 203. The text 
conversion portion 202 converts the attribute information on the 
characters or the string of characters searched by the text searching 
portion 201 according to a conversion rule retained in the 
conversion rule retaining portion 203, and outputs output text data 
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T2. The conversion rule retaining portion 203 stores the 
conversion rule table for converting certain attribute information 
into another attribute information, out of the attribute information 
on the characters or the string of characters included in the input 
text data T 1 . 

[0106] Figure 20 shows a configuration example of the 
conversion rule table when the input text data Tl is 3D text data 
and the output text data T2 is 2D text data. It is noted that herein; 
the 3D text data and the 2D text data are described in an XML 
format. 

[0107] In such the configuration example, the conversion rule 
table includes a conversion rule for converting tags for producing 
the 3D effect on the characters or the string of characters into 
attribute information for producing a 2D decorated character (italic 
character) on the characters or the string of characters, and a 
conversion rule for increasing a font size (attribute) of such the 
characters or the string of characters corresponding to a level of 
the 3D effect (protruding amount). Herein, the font size is set in 
such a manner as to increase only by 1 pt (point) per each 
protruding amount. 

[0108] In Figure 20, <text font = 12pt> described in each text 
data indicates that data succeeding thereto is text data of which 
font size is 12 pt, and </text> indicates an end of the text data. In 
addition, <3D d = 2> and <3D d=l> described in the 
three-dimensional text data indicate that the three-dimensional 
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effect is produced on the characters or the string of characters 
succeeding thereto, and in addition, levels of the protruding 
amounts of the characters or the string of characters are a level 2 
(d = 2) and a level 1 (d=l). Herein, the larger values of the levels, 
the larger the protruding amounts. 

[0109] In addition, <it font = 14 pt> and <it font = 13 pt> 
described in the 2D text data indicate that the character 
decorations in which font sizes are 14 pt and 13 pt and in which 
fonts are italic (it: italic) are produced on the characters or the 
string of characters succeeding thereto, and </it> indicates an end 
of the character decorations. 

[0110] Figure 21 shows a flowchart at a time of converting 
the input text data Tl according to such the conversion table. 

[0111] When a conversion process is started, the input text 
data Tl (3D) is input into the text searching portion 201 (S101), 
and characters or a string of characters to which the tags for 
producing the 3D effect is added are searched out of the characters 
or the string of characters in the input text data Tl (S102). At 
this time, if there are the characters or the string of characters to 
which the tags for producing the 3D effect is added, the protruding 
amounts of the characters or the string of characters are extracted 
at the same time. Then, extracted information, the input text data 
Tl, and the conversion rule table retained in the conversion rule 
retaining portion 203 are provided to the text conversion portion 
202 (S103). 
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[0112] According to the conversion rule table, the text 
conversion portion 202 converts the tags of the characters or the 
string of characters searched in the above S102 into the tags for 
meaning the fonts of the characters or the string of characters to 
italic (it: italic), increases the font sizes of the characters or the 
string of characters by corresponding to the 3D protruding amount, . 
and converts the characters or the string of characters into the 
two-dimensional text data (S104). Then, the text conversion 
portion outputs the converted text data as the output text data T2. 

[0113] Figure 22 shows a display example in such the case. 
A lower left side of Figure 22 shows a display example when the 
input text data Tl (3D) is 3D-displayed, and a lower right side of 
Figure 22 shows a display example when the converted output text 
data T2 (2D) is 2D-displayed. 

[0114] As shown in Figure 22, the above-described process 
makes it possible to convert the string of characters on which the 
3D-dimensional effect has been (was due to be) produced (a string 
of characters in a portion surrounded by dotted lines in Figure 22) 
into a string of italic characters in an expanded and 
two-dimensional display manners. Therefore, it is possible to 
emphasize the string of characters on which the 3D effect has been 
(was due to be) produced in the two-dimensional display. As a 
result of this conversion, it is possible that an intention of the 
creator who created the input text data Tl is reflected on the 
two-dimensional display, and even in an apparatus only provided 
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with the two-dimensional display function, it is possible to 
appropriately transmit and display the information according to the 
intention of the creator. 

[0115] It is noted in the above, when the 3D text data is 
converted into the 2D text data, a style of the character decoration 
(italic) and the font size are simultaneously converted. However, - 
even if only the style of the character decoration (italic) is 
converted, or if only the font size is converted, it is still possible 
to demonstrate an emphasizing effect of the string of 3D 
characters. 

[0116] In addition, in the above, the style of the character 
decoration is italic. However, it may be possible to adopt other 
character decoration styles approximate to the 3D display such as a 
shaded character, a bold character, etc. 

[0117] Furthermore, in the above, the protruding amount of 
the 3D effect is simply expressed by a magnitude of numerical 
values (d = 1, 2, •*•). However, it is also possible to express by 
units such as mm (millimeter), cm (centimeter), etc., or a 
description of a measurement such as "large", "medium", "small", 
etc., too. It is noted that in this case, too, regarding the size of 
the font, a point size may be changed corresponding to the 
protruding amount. 

[0118] Incidentally, the above illustrates an example that the 
conversion rule table converts the 3D text data into the 2D text 
data, a process flow and an example of displayed output using the 
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conversion rule table. In addition to this configuration, it is also 
possible to create a conversion rule table for converting the 2D text 
data into the 3D text data. For example, contrary to the above 
example, in a case that tags for producing the 2D character 
decoration (italic, for example) on the characters or the string of 
characters are described, it may be possible that a conversion rule 
for converting the tags of the 2D characters or the string of 2D 
characters into tags for producing the 3D effect is included in the 
conversion rule table, or in a case that attribute information for 
making the font sizes of the characters or the string of characters 
larger than normal is described, it is possible that a conversion rule 
for converting the attribute information into attribute information 
for allowing the characters or the string of characters to be 
stereoscopically displayed by a protruding amount corresponding 
to an increase of the font sizes is included in the conversion rule 
table. 

[0119] For example, contrary to the above-described 
conversion of the 3D into the 2D, if it is defined by the conversion 
rule that the tags of the character is italic, and that the tags are 
converted into tags for producing the 3D effect of the protruding 
amount corresponding to the font size of the character decoration, 
it is possible to convert the 2D text data shown in Figure 22 into 
the 3D text data of Figure 22. Thus, as a lower left side of Figure 
22 shows, it becomes possible to 3D-display these characters or the 
string of characters in a more impressive manner than a normal 
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two-dimensional display. 

[0120] In addition, in the above, although the data is 
described in the XML format, another format may be used. It is 
possible to use an arbitrary data format in which attributes such as 
a font, italic, a 3D, etc. are applied as the decoration information 
partially toward the characters or the string of characters. 

[0121] (Specific example) A specific example of a case that 
the above-described text conversion process tool is applied to a 
mobile terminal device will be shown. Figure 23 is a diagram 
showing a configuration of the mobile terminal device. 

[0122] It is noted that in this specific example, the 
above-described text conversion process tool is mounted by being 
downloaded into a memory inside the mobile terminal device from 
a public network via a communication module 101 shown in Figure 
23, for example. In addition, it is noted that the mobile terminal 
device shown in Figure 23 is not provided with the 3D display 
function. Thus, the mounted text conversion tool is a tool for 
executing a function for converting the 3D text data into the 2D 
text data. 

[0123] As shown in Figure 23, the mobile terminal device is 
provided with the communication module 101, a communication 
processing portion 102, an operation panel 103, an input 
processing portion 104, a monitor panel 105, a display controller 
106, an audio input/output interface 107, an audio processing 
portion 108, a CPU 109, and a RAM 110. 
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[0124] The communication module 101 is provided with a 
wireless communication module such as an antenna, etc., and 
carries out a communication with the public network via radio 
wave. The communication processing portion 102 applies a 
process corresponding to a communication protocol toward data to 
be transmitted and received via the communication module 101. 

[0125] The operation panel 103 is provided with operation 
means such as an operation key, etc., and outputs a signal 
corresponding to an operation result to the input processing portion 
104. The input processing portion 104 converts the signal 
received from the operation panel 103 into data, and outputs the 
data to the CPU 109. 

[0126] The monitor panel 105 is provided with display means 
such as a liquid crystal monitor, etc., and displays a display screen 
corresponding to a process from the display controller 106. The 
display controller 106 generates the display screen according to 
image data input from the CPU 109, and displays the display screen 
on the monitor panel 105. 

[0127] The audio input/output IF (interface) 107 is provided 
with an interface for inputting/outputting audio, outputs an audio 
signal input from an audio inputting means to the audio processing 
portion 108, and outputs from an audio outputting means the audio 
corresponding to the audio signal received from the audio 
processing portion 108. The audio processing portion 108 
converts into audio data the audio signal received from the audio 
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inputting/outputting IF 107, and outputs the audio data to the CPU 
109. In addition, the audio processing portion 108 converts into 
the audio signal the audio data received from the CPU 109, and 
outputs the audio signal to the audio inputting/outputting IF 107. 

[0128] The CPU 109 executes various kinds of processes 
according to various kinds of programs mounted in the mobile 
terminal device. The RAM 110 sequentially stores various kinds 
of data handled by the CPU 109. 

[0129] For example, upon receipt of electronic mail data 
including a text data file from the public network, such the 
electronic mail data is obtained and analyzed by the CPU 109 
according to an electronic mail processing program, and is stored 
in the RAM 110. At this time, if the text data file stored in the 
RAM 110 is the three-dimensional text data, this data is applied to 
a conversion process by the CPU 119, and converted into the 
two-dimensional text data according to a text data conversion 
processing program, and is stored into the RAM 110 as another file. 
It is noted that such the conversion process is carried out according 
to the descriptions referring to Figure 19 to 22. 

[0130] Thereafter, if a display instruction of such the text 
data file is input via the operation panel 103, the CPU 109 reads 
out the two-dimensional text data from the RAM 110 so as to 
generate the image data, and outputs this image data to the display 
controller. Upon receipt of this image data, the display controller 
106 generates an image corresponding to the two-dimensional text 
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data, and displays this image on the monitor panel 105. As a 
result, an image as shown on a lower right side of Figure 22 is 
displayed on the monitor panel 105, for example. 

[0131] It is noted that in this embodiment, by taking an 
example of the mobile terminal device not having the 3D display 
function, an applicable example of the above embodiment is 
described. However, in a case of adapting the above embodiment 
to a mobile terminal device having the 3D display function, instead 
of the text conversion tool for executing the function of converting 
the 3D text data into the 2D text data, a text conversion tool for 
executing a function of converting the 2D text data into the 3D text 
data is mounted in the mobile terminal device. In this case, the 
text conversion tool is activated in a case that the text data file 
received by an electronic mail system is the 2D text data, and a 
process for converting the 2D text data into the 3D text data is 
executed by the CPU 109. Then, the converted 3D text data is 
stored in the RAM 110 as another file. It is noted that regarding 
the conversion process, see above. 

[0132] It is noted that in this case, it is possible to display 
the text data either in a 3D manner or a 2D manner. Therefore, it 
may be possible that the user is asked which display manner the 
user may choose, and corresponding to a selection instruction in 
response thereto, the display manner of the output (3D manner or 
2D manner) is appropriately set. Or, it may be possible that the 
display is usually performed in the 3D manner, and corresponding 
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to a switch instruction from the user, the display is changed to the 
2D manner. In addition, on the contrary, it may also be possible 
that the display is usually performed in the 2D manner, and 
corresponding to the switch instruction from the user, the display 
is changed to the 3D manner. 

[0133] It is noted that in any case of the embodiments, the 
text data based on any display manner, that is, the 3D manner or the 
2D manner, may be sent to a transmission destination at a time of 
transferring electronic mail. Therefore, at a time of transferring 
the electronic mail, the user may be asked which text data, that is, 
text data yet to be converted or text data already converted, the 
user may choose to transmit. 

[0134] In addition, besides electronic mail data, in browsing 
a homepage having three-dimensional tags, too, the above 
conversion process may be carried out corresponding to the display 
manners, that is, the 3D manner or the 2D manner, of the receiving 
terminal. 

[0135] Although the present invention has been described and 
illustrated in detail, it is clearly understood that the same is by 
way of illustration and example only and is not to be taken by way 
of limitation, the spirit and scope of the present invention being 
limited only by the terms of the appended claims. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a view showing an embodiment of the present 
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invention, and a block diagram showing an example of architecture 
of a personal computer; 

Figure 2 is a view showing an embodiment of the present 
invention, and a block diagram showing an example of a 
configuration of a video card; 

Figure 3 is a view showing an embodiment of the present 
invention, and a descriptive diagram of a stereoscopic viewing-use 
rendering process of a file by a personal computer (browser 
software); 

Figure 4 is a view showing an embodiment of the present 
invention, and a descriptive diagram of a stereoscopic viewing-use 
rendering process of a file by a personal computer (browser 
software); 

Figure 5 is a view showing an embodiment of the present 
invention, and a descriptive diagram showing a description 
example of a file; 

Figure 6 is a view showing an embodiment of the present 
invention, and a descriptive diagram showing a description 
example of a file; 

Figure 7 is a view showing an embodiment of the present 
invention, and a descriptive diagram showing a description 
example of a file; 

Figure 8 is a view showing an embodiment of the present 
invention, and a descriptive diagram showing a description 
example of a file; 



60 



Figure 9 is a view showing an embodiment of the present 
invention, and a descriptive diagram showing a description 
example of a file; 

Figure 10 is a view showing an embodiment of the present 
invention, and a descriptive diagram showing an example of a 
rotating image; 

Figure 11 is a view showing an embodiment of the present 
invention, and a descriptive diagram showing a description 
example of a file; 

Figure 12 is a view showing an embodiment of the present 
invention, and a descriptive diagram showing a principle of a 
stereoscopic viewing; 

Figure 13 is a view showing an embodiment of the present 
invention; 

A portion (a) of Figure 13 is an example of a 
non-stereoscopic display; 

Portions (b), (c) of Figure 13 are descriptive diagrams 
showing examples of a stereoscopic display in which a size of 
characters to be stereoscopically viewed is expanded; 

Figure 14 is a view showing an embodiment of the present 
invention; 

A portion (a) of Figure 14 is a descriptive diagram of a 
non-stereoscopic display of "£"; 

A portion (b) of Figure 14 is a descriptive diagram of a 
stereoscopic display of "£"; 
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Figure 15 is a descriptive diagram of an embodiment of the 
present invention, and a descriptive diagram of a stereoscopic 
display of "Z"; 

Figure 16 is a view showing an embodiment of the present 
invention; 

Portions (a), (b), and (c) of Figure 16 are descriptive 
diagrams of stereoscopic displays of "E"; 

Figure 17 is a view showing an embodiment of the present 
invention; 

A portion (a) of Figure 17 is a descriptive diagram of a 
non-stereoscopic display of characters with strike-throughs; 

A portion (b) of Figure 17 is a descriptive diagram of a 
stereoscopic display of characters with strike-throughs; 

A portion (c) of Figure 17 is a descriptive diagram of four 
kinds of strike-throughs; 

Figure 18 is a view showing an embodiment of the present 
invention, and a descriptive diagram showing attribute information 
of each character in a main text; 

Figure 19 is a view showing an embodiment of the present 
invention, and a functional block diagram of a text conversion tool; 

Figure 20 is a view showing an embodiment of the present 
invention, and a view of one example of a conversion rule table; 

Figure 21 is a view showing an embodiment of the present 
invention, and a flowchart showing a text data conversion process; 

Figure 22 is a view showing an embodiment of the present 
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invention, and a view showing an example of a conversion process 
of text data; and 

Figure 23 is a view showing an embodiment of the present 
invention, and a view showing a configuration of a mobile terminal 
device. 



